- Support the development and maintenance of data pipelines using Databricks, Spark, and similar technologies.
- Write and optimize SQL and Python scripts for data transformation, integration, and automation tasks.
- Develop automation scripts that populate metadata and comments across Databricks tables using structured definitions.